#efficient training

'MobileLLM-R1 is Meta's compact edge reasoning family (140M–950M parameters) that achieves significant math and coding gains over other open models while being far more data efficient.'

Huawei has introduced Pangu Ultra MoE, a 718 billion parameter sparse language model optimized for Ascend NPUs using simulation-driven architecture and advanced system-level optimizations to achieve high efficiency and performance.